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METHOD AND SYSTEM FOR THE VISUALLY IMPAIRED TO NAVIGATE 
A ROUTE THROUGH A FACILITY 



Field of the Invention 

The present invention relates generally to the field of electronically aided navigation through 
a facility and in particular to a method and apparatus for guiding visually impaired individuals along 
a route in a facility to obtain items or visit locations chosen by the individual. 

Background Information 

Various methods and systems have been devised to aid visually impaired individuals in 
unfamiliar surroundings. Devices and systems have been developed in the past to guide the visually 
impaired by utilizing detection devices to warn the user of obstacles. These prior art systems merely 
react and signal the user of obstacles and do not aid the user in navigating a route. 
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Other devices have been developed which aid visually impaired individuals toward specific 
locations by utilizing remote modules located at specific locations and a mobile module carried by 
the individual recording distances and transmitting information to the user. Although these devices 
do aid visually impaired individuals to be more mobile and self-sufficient they do not allow for the 
user to detail his own task list and have the system create a route for him to travel in a manner to 
efficiently accomplish the tasks on the list. 

It would be a benefit therefore to have a navigation system that allows an individual to create 
his own task list and have a route provided to accomplish the tasks listed. It would be a further 
benefit to have a navigation system that allows an individual to create his own task list and 
electronically submit it to a service provider for the preparation and downloading of a route into the 
user's personal digital device so as to navigate the route and complete the tasks within a particular 
facility. It would be a still further benefit to have a navigation system that is adapted for use with 
many existing electronic label systems currently existing in facilities. 
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Summary of the Invention 

It is thus an object of the present invention to provide a navigation system that allows an 
individual to create his own task list and have a route provided for the individual to accomplish the 
tasks on the list. 

It is a further object of the present invention to provide a navigation system that allows an 
individual to create his own task list and electronically submit it to a facility for the preparation and 
downloading of a route into the user's personal digital device so as to navigate the route and 
complete the tasks within the particular facility. 

It is a still further object of the present invention to provide a navigation system that interacts 
with many systems already existing in facilities. 

Accordingly, a system and method of the type for aiding a user in navigating a route through 
a facility so as too efficiently locate specific items within a facility is provided. The system includes 
a facility processor having a database and software stored thereon for mapping an interactive route 
from selected location to selected location within a facility, a label located proximate individual 
items, the label electronically communicating information specific to the item it is associated with, 
and a digital device having the interactive route electronically stored thereon, the digital device 
electronically communicating with the facility processor and the labels for tracking movement of the 
digital device along the r6ute via communication with the labels and communicating a direction to 
move to follow the route. 
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A user creates a list of items to acquire, or locations to visit that are specific to a facility. The 
user then provides this list to a facility processor at the facility or via a network. An interactive route 
is then created to provide an efficient route for the user to locate all the items on the list. This route 
is downloaded onto the user's digital device for utilization in the facility. The system utilizes two- 
5 way communication between the labels and the digital device and the digital device and the facility 
processor when necessary to navigate through the facility. The digital device indicates a direction 
to follow until a listed item is located. The system may utilize any means necessary, such as visual, 
audio, and/or physical stimulation, to communicate to the user a direction to travel or when an item 
is located. This system may be used by the visually impaired. The interactive route program may 
1 0 also allow the user to skip items or move through the list and select specific items, the route being 
adjusted according to the item selected. 

The foregoing has outlined rather broadly the features and technical advantages of the present 
invention in order that the detailed description of the invention that follows may be better 
understood. Additional features and advantages of the invention will be described hereinafter which 
1 5 form the subject of the claims of the invention. 
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Brief Description of the Drawings 

For a more complete understanding of the present invention, and the advantages thereof, 
reference is now made to the following descriptions taken in conjunction with the accompanying 
drawings, in which: 

Figure 1 is an illustration of the navigation system of the present invention. 

Figure 2 is a system diagram of a data processing system, including hardware and firmware, 

which may be used to implement the present invention. 

Figure 3 is an illustration of a navigation system of the present invention utilizing radio 
frequency (RF) communication. 

Figure 4 is a flowchart of a method of initiating the navigation system of the present 
invention. 

Figures 5A, 5B, 5C is a flowchart of a method of the navigation system of the present 
invention. 
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Detailed Description 

Refer now to the drawings wherein depicted elements are not necessarily shown to scale and 
wherein like or similar elements are designated by the same reference numeral through the several 
figures. 

Figure 1 is an illustration of the navigation system of the present invention generally 
designated by the numeral 10. Navigation system 10 includes a facility processor 12, a personal 
digital device 14, and a facility 16. System 10 as shown is adapted for use in a facility such as a 
grocery store or other sales facility. It should be recognized that navigation system 1 0 of the present 
invention may be utilized in many different types of facilities, such as, but not limited to grocery 
stores, department stores, hardware stores, entertainment centers and the like. For brevity and clarity 
navigation 10 is described for utilization in a grocery store for aiding visually impaired persons to 
navigate shopping routes to obtain particular items. 

Facility processor 12 may be a dedicated personal computer system, a store controller, or a 
manager's workstation. Facility processor 12 may be a stand-alone processor or connected to other 
processors, such as, but not limited to, a corporate headquarters, through a network (not shown). 
Typically, facility processors will contain inventory data, facility location of inventory, price lists, 
and promotional offers among other data necessary to operate a sales facility. 

Personal digital device 14 is an independently powered, stand-alone, two-way wireless 
communication device. Personal digital device 14 may be a device such as, but not limited to, a 
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personal digital assistant, laptop computer, cell phone or other similar device. Personal digital 
device 10 will have software loaded to allow communication with facility processor 12 and labels 
18 (Figure 3). 

A representative hardware environment which can be used for practicing the present 
5 invention is depicted with reference to Figure 2, which illustrates the hardware configuration of a 
data processing system 2 1 3 in accordance with the subject invention. The representative system may 
be utilized, in whole or in part, for various elements of the present invention such as facility 
processor 12, personal digital device 14, and label 18 shown in Figure 3. 

The data processing system 213 includes a centra] processing unit (CPU) 210, such as a 
0 conventional microprocessor, and a number of other units interconnected via a system bus 2 1 2 . The 
data processing system 2 1 3 includes a random access memory (RAM) 2 1 4 and a read only memory 
(ROM) 216, and may include flash memory. Data processing system 213 may also include an I/O 
adapter 21 8 for connecting peripheral devices such as disk units 220 and tape drives 240 to the bus 
212, a user interface adapter 222 for connecting a keyboard 224, a mouse 226 and/or other user 
5 interface devices such as a touch screen device to the bus 212, a communication adapter 234 for 
connecting the data processing system 213 to a data processing network 242, and a display adapter 
236 for connecting the bus 2 1 2 to a display device 23 8 which may include sound. The CPU 2 1 0 may 
include other circuitry not shown herein, which will include circuitry found within a microprocessor, 
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e.g., an execution unit, a bus interface unit, an arithmetic logic unit (ALU), etc. The CPU 2 1 0 may 
also reside on a single integrated circuit (IC). 

Figure 3 is an illustration of navigation system 10 of the present invention utilizing radio 
frequency (RF) communication. As shown, facility 1 6 includes facility processor 1 2 and a plurality 
of labels 18. Facility processor 12 contains stored information such as store inventory, price lists, 
store diagrams, label 18 locations in the facility, and promotional information. Facility processor 
1 2 may include software which allows mapping of the locations of labels 1 8 in facility 1 6. Facility 
processor 12 is connected to one or more RF links 20 for transmitting and receiving radio 
frequencies. It should be recognized that the system is described utilizing radio frequency, however, 
infrared technology or hard-wire communication may be utilized. 

Each label 18 may be an independently powered, stand-alone, two-way communication 
device. Label 18 may be a radio frequency identification tag. Labels 1 8 are placed along shelves, 
such as in a grocery store, adjacent to a product that it identifies. As represented in Figure 3, labels 
18 have been placed on two rows of shelves forming an aisle. Labels 18 may be loaded with 
information such as the location of label 1 8, the item represented, item price, and promotional offers. 
This information may be pre-loaded and/or edited via communication from facility processor 12. 
Labels 1 8 may be programmed to transmit information back to facility processor 12. 
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The electronic label system as shown in Figure 3 may be utilized with systems available for 
use in retail facilities. The present invention utilizes these in-place and readably available systems in- 
part, to aid the visually impaired to shop in a self-sufficient and timely manner. 

A user creates a task list and has an interactive route, created to locate each item listed, 
loaded via a network or directly from facility processor 12 at facility 16 into personal digital device 
14. Once the route is downloaded and the user and personal digital device 14 enter a particular 
facility 16, personal digital device 14 polls labels 18 within transmission range. When a label 18 is 
polled it will respond with an item identification such as a barcode and may transmit a location and 
additional information. When personal digital device 14 receives the signal from a label 18, it 
processes the information sent, comparing it to the route identified and indicates to the user if it is 
a product he desires or may indicate that the user is to move forward or in a different direction. 
Personal digital device 14 may transmit the received barcode from a label 18 and send it to facility 
processor 12 to receive the location of personal digital device 14 for routing information. The 
personal digital device may provide information to the user utilizing audible, visible, and/or physical 
stimulation methods such as a synthetic voice, buzzers, vibration, braille display, or lights depending 
on the ability of the user. 

By requesting as little information as possible from labels 18, the label's battery life is 
prolonged. Additionally, if the wireless link between label 1 8 and personal digital device 14 is limited 
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limited to a very short range, navigation system 10 can more accurately pinpoint the location of the 
shopper on the route. 

Figure 4 is a flowchart of a method of initiating navigation system 1 0 of the present invention 
described with reference to Figures 1 through 3. A shopper creates a shopping list, step 410. The 
shopper then transmits the list to facility processor 12, step 420. The shopper may transmit the list 
to facility processor 12 via a network or upload the list at facility 1 6. The list may be a hard copy 
and scanned into facility processor 12. In step 430, facility processor 12 compares the listed items 
to the location of the items in the store and creates an optimal route through facility 1 6 to obtain the 
items listed. The route may be recalculated during use if the user elects to skip an item listed. In 
step 440, the route is loaded into personal digital device 14 of the user either over a network or at 
facility 16. 

Figure 5 A is a flowchart of a method of navigation system 10 of the present invention 
described in relation to Figures 1 through 4. Once the shopper has the route loaded into his personal 
digital device 14 ,he initiates the programing and shopping route in step 510. In step 510, the 
shopper initiates the navigation program by inputting a request for the first product. The shopper 
may input the request by typing it into the personal digital device 14, utilizing voice recognition, 
utilizing a dedicated key on the personal digital device 14, or any other method known to operate a 
computing device by the visually impaired. In step 520, personal digital device 14 queries a label 
18 for a barcode. If more than one label 18 transmits a barcode, personal digital device 14 accepts 
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the strongest signal. In step 530, personal digital device 14 queries label 18 for a location; if no 
location is transmitted from label 1 8, the information is obtained from facility processor 1 2. In step 
540, if personal digital device 14 recognizes the barcode as an item listed, the process continues as 
shown in Figure 5B. If the barcode is not recognized as an item desired, personal digital device 14 
compares the location of the previous label 1 8 with that of the current label 1 8 location, step 550. 
In step 560, personal digital device 14 determines if the shopper is moving in the correct direction. 
If the shopper is not moving in the correct direction, the correct direction is calculated, step 570, and 
the correct direction is indicated to the shopper in step 590. If the shopper is moving in the correct 
direction, that direction is set in step 580 and is indicated to the shopper in step 590. This process 
is continued until the shopper locates the first item listed. 

Figure 5B is a flowchart of a method of navigation system 10 of the present invention 
described in relation to Figures 1 through 5A. Figure 5B is an illustration of the found product 
process of system 10. Once the barcode transmitted from a label 18 matches an item listed, an 
indication is given to the shopper that the item is located, step 600. In step 610, personal digital 
device 14 inquires if the shopper responds to the found item. If the shopper does not respond to 
personal digital device 14, the barcode is again checked against the item listed, step 620. If the 
barcode matches the listed item, the process resets to step 600. This loop continues for a set number 
of times. If the barcode does not match the listed item, the process resets to step 520. If the shopper 
responds that the item is found, personal digital device 14 queries if the shopper would like a price 
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check, step 630. If price is requested, personal digital device 14 queries label 18 and/or facility 
processor 12 for the price, step 640. The price received is then stored in a running price total, step 
650. Then system 10 is set to locate the next item listed in step 660 and the process continues as 
shown in Figure 5C. If the shopper does not request a price in step 630, system 10 waits a specified 
time for a response, step 670. If the preset wait time passes, step 680, system 10 is set to the next 
product listed, step 660. If the shopper indicates by pushing a button or submits a response in 
another manner established for another item in step 690, the method continues as shown in Figure 
5C. If the shopper does not give an indication as to price request in steps 670-690, the program 
repeats a set number of times before moving to step 660. 

Figure 5C is a flowchart of a method of navigation system 10 of the present invention 
described in relation to Figures 1 through 5B. Figure 5C illustrates the next selection process which 
may be utilized at anytime, for example if the shopper decides to reduce the list because of time 
constraints or money concerns. In step 700, personal digital device 14 provides for selection of a 
previous item or next item. This step may always be available by vocal command or by physical 
command and also includes indications from personal digital device 14 to the shopper of the next 
item to pursue. Whichever direction the shopper chooses to go through the list, once an item is 
selected personal digital device 1 4 calculates a route to the selected item, steps 71 0 and 720. In step 
710, the shopper selects an item earlier in the list and the interactive route recalculates a route from 
the current location. In step 720, the interactive route recalculates a route from the current location 
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to the item selected that is not the next listed item in the original list. In step 730, the item is selected 
and the direction to move is indicated to the shopper, step 740. The process then continues to step 
5 1 0. The process may be terminated upon the shoppers request or once all the listed items have been 
found. Upon completion of the item list, digital device 1 4 may indicate a route to a payment station 
and/or exit (not shown). 

Although the present invention and its advantages have been described in detail, it should 
be understood that various changes, substitutions and alterations can be made herein without 
departing from the spirit and scope of the invention as defined by the appended claims. It should be 
recognized that the present method and system may be utilized by any individual to speed shopping 
or locating items in a facility. The label may be a wireless communication device that does not have 
the ability to visually display information. 
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